Recovering Missing Depth Information from Microsoft’s Kinect
نویسندگان
چکیده
This paper presents a technique to estimate missing depth information obtained from the Microsoft Kinect. Due to the limitations of the depth sensing technology used by the Kinect, a significant loss and noise incurs when capturing depth information. The paper describes the steps needed to go from raw depth, as captured by Kinect, to a point cloud representation of the recovered missing data. Our main contribution in this paper is the use of an iterative diffusion method that accounts for both the known depth values and RGBD segmentation results to recover missing depth information. The algorithm proposed is highly parallelizable and is capable of being implemented for real-time processing by utilizing the Graphical Processing Unit.
منابع مشابه
Recognizing Hand Gestures with Microsoft’s Kinect
In this paper, we propose and implement a novel method for recognizing hand gestures using rgb and depth data from Microsoft’s Kinect sensor. Our approach involves looking at specific hand motions, in addition to full body motions, to assist in the recognition of more refined gestures. With this approach, we are able to recognize ‘grasp’ and ‘drop’ gestures with over 90% accuracy.
متن کاملTemporal Filtering of Depth Images using Optical Flow
We present a novel depth image enhancement approach for RGB-D cameras such as the Kinect. Our approach employs optical flow of color images for refining the quality of corresponding depth images. We track every depth pixel over a sequence of frames in the temporal domain and use valid depth values of the same point for recovering missing and inaccurate information. We conduct experiments on dif...
متن کاملA Hand Gesture Recognition Library for a 3D Viewer Supported by Kinect’s Depth Sensor
In modern life, human–computer interaction has received the most interest from researchers, especially in developing new interaction methods. Microsoft’s Kinect sensor, which has integrated red-green-blue and depth (RGB+D) cameras, opens up new possibilities As well, many three-dimensional (3D) applications have been developed fashioning the computer world more natural and real for the user. In...
متن کاملReal Time Relighting with Dynamic Light Environment Using an RGB-D Camera
Relighting techniques often require knowledge about the shape and the reflectance property of a target object and the light environment. The quality of the relighting is highly dependent on the normals accuracy of the object since they are used for the computation of the illumination. We propose a new relighting approach for arbitrary shaped objects with dynamic light environment using an RGB-D...
متن کاملHand Detection and Tracking Using Depth and Color Information
The detection and tracking of a hand is an emerging research issue now-a-days to control the devices by hand motion. Conventional hand detection methods use color and shape information from a RGB camera. With the recent advent of the depth camera, some researchers show that they can improve the performance of hand detection by combining the color (or intensity) information with the information ...
متن کامل